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Abstract 

The  problem  of  approximating  a bandllmited 
but  otherwise  arbitrary  signal  by  a free  solution 
to  a linear,  time-lnvaricit,  differential  equa- 
tion Is  solved.  Optimal  solutions  for  the  equa- 
tion parameters  are  derived  for  equations  of  any 
dynamic  order.  Applications  are  discussed  and 
examples  In  state  reconstruction  and  Inverse 
filtering  In  the  presence  of  unknown  disturbances 
are  given. 

1.  Introduction 

In  practice,  one  often  has  only  partial  In- 
formation regarding  the  character  of  certain  sig- 
nals that  are  present  In  or  act  upon  a system, 
examples  being  load  torque  disturbances  it*,  hccvy 
machinery  and  electronic  noise  In  certain  semi- 
conductor devices.  For  either  signal  processing 
or  feedback  control.  It  Is  Important  to  be  able 
to  reconstruct  such  signals  from  output  measure- 
ments alone.  The  question  of  this  reconstruction 
Is  solved  here  for  the  class  of  such  signals  which 
are  bandllmlted,  but  otherwise  unknown.  The  ap- 
proach Involves  optimal  approximation  of  the  band- 
limited  algnal.  In  the  aense  of  Integral-square 
bandpass  error,  as  the  homogeneous  solution  of  a 
linear,  time-invariant,  ordinary  differential 
equation  with  unknown  Initial  conditions.  The 
optimization  determines  the  coefficients  of  the 
differential  equation  thus  specifying  the  model. 

The  organization  of  the  paper  Is  as  follows. 

In  Section  2 further  motivation  Is  givetr  for  this 
work  by  showing  how  the  theoretical  problem  arises 
from  considerations  In  the  application  of  observ- 
ers and  observer-controllers  in  feedback  control. 

The  signal  modeling  problem  is  formulated  In 
Section  3,  where  It  Is  cast  as  an  equivalent  new 
filtering  problem.  In  Section  4,  a performance 
criterion  and  constraints  are  chosen,  and  the  opti- 
mal solutions  are  found  In  closed  form. 

IVo  application  examples  are  presented  In 
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Section  5,  and  conclusions  are  given  In  Section  6, 

2.  Motivation:  Observing  the  State  of 
Systems  with  Unknown  Inputs 

Observer  Design 

When  the  state  of  a plant  Is  not  available  to 
a control  system  for  feedback.  It  may  be  estimated 
by  a dynamic  observer  [l— 3 J or  state  estimator 
[4].  Providing  that  the  plant  Is  completely  ob- 
servable, an  observer  which  monitors  the  plant  In- 
puts and  outputs  may  be  constructed  to  generate 
signals  which  converge  arbitrarily  rapidly  to  the 
system  state,  within  the  practical  llmltatlona  of 
measurement  noise  and  parameter  errors. 

When  an  observer  estimate  of  the  plant  state 
is  used  for  feedback  in  place  c£  the  state.  Itself, 
the  eigenvalues  of  the  composite  system  are  those 
of  the  observer  (which  may  be  chosen  by  the  de- 
signer), together  with  those  of  the  plant  which 
would  result  If  the  state  Itself  were  fed  back  In 
place  of  the  observed  state. 

In  special  cases,  It  Is  possible  to  observe 
the  state  of  a system  without  having  access  to  one 
or  more  of  the  system  inputs  [5-8].  Except  In 
these  cases.  It  Is  necessary  to  have  all  plant  In- 
puts available  to  the  observer,  and  this  require- 
ment Is  a severe  restriction  on  the  usefulness  of 
observers  In  many  situations. 

When  all  unknown  Inputs  may  be  effectively 
characterized  probabilistically,  optimal  stochas- 
tic filtering  [9]  Is  clearly  Indicated.  In  prac- 
tice, however,  there  exist  many  situations,  for 
example,  structural  systems  with  wind  gust  dis- 
turbances and  chemical  processes  with  reactant 
impurities.  In  which  the  system  Inputs  are  unknown 
(or  poorly  known)  even  In  a statistical  sense. 

Observers  Which  Approximate  Unknown  Plant  Inputs 

A general  method  of  accommodating  unknown 
plant  Inputs  in  observers  Is  to  represent  such 
signals  as  solutions  of  constant-coefficient, 
ordinary,  linear,  differential  equations.  The 
plant  equations  are  augmented  to  represent  the  un- 
known Inputs,  and  the  resulting  observer  generates 
estimates  of  these  Inputs  as  well  as  the  plant 
state. 

This  approach  began  vlth  the  work  of  Johnson 
[lO-ll],  Pearson  [12]  and  Davison  [13-14],  with- 
out explicit  connection  to  observer  theory. 
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Bryson  and  Lucnhcrger  took  on  observer  viewpoint 
of  a slmllnr  problem  [li]  and  Young  and  Willems 
considered  a more  general  problem  class  [l6j. 
Hostctter  and  Hedltch  related  Davison's  work  to 
the  observer  approach  [l 7 ] and  Investigated  the 
structure  and  properties  of  these  observers  In 
quite  some  detail  [18-19]. 

Although  there  ore  situations  where  an  Inac- 
cessible Input  signal  is  known  to  satisfy  a 
specific  differential  equation,  for  example  power 
line  "hum".  In  most  cases  the  differential  equa- 
tion for  an  unknown  signal  will  be  only  an  approxi- 
mating equation,  Just  as  are  the  equations  which 
model  the  plant.  The  question  thus  arises  as  to 
a "best"  approximating  equation  for  certain 
classes  of  Input  signals. 

3.  Problem  Formulation 


Representing  Signals  as  Solutions  to  Differential 
Equations 


Let  an  unknown  signal  f(t)  be  represented  as 
a solution  f'(t)  to  the  scalar  differential 
equation  „ „ + 


a (dnf ’/dtn)  + a .(d" 
n n— ± 


♦ aAdf'/dt)  ♦ a £’-  0 
X o 


a) 


Ideally,  the  unknown  signal  f(t)  would  satisfy 
this  differential  equation  exactly.  But  if  a 
solution  of  the  equation  only  approximates  f(t), 
then  _ _ -i  _ i 

a (dnf/dt”)  + a .<dn  Xtl dt”  X)  + 
n n-j. 


...  + a1(df/dt)  + aof  - e(t),  (2) 

where  e(t)  Is  an  error  signal.  Indicative  of  the 
quality  of  the  approximation. 


An  Equivalent  Filter 

The  relation  (2)  may  be  viewed  as  a filtering 
problem  where  f(t)  is  the  filter  input,  e(t)  is  the 
filter  output  and  the  filter  transfer  function  is 

T(s)  - ans"  + •n_1»n  1 + ...  + SjS  + ao. 


One  may  then  view  the  problem  of  determining  para- 
meters of  an  approximating  differential  equation 
as  an  equivalent  problem  of  determining  parameters 
of  a filter,  T(a). 

This  equivalent  filter  has  all  xeros  and  Is 
thus  not  realizable  as  a flnlte-dlmenslonal  dynamic 
linear  system  [20],  But  the  equivalent  filter  is 
Just  an  analytic  convenience,  not  the  end  result. 


Filter  Characteristics  for  Bandllmlted  Signals 

If  the  unknown  signal  f(t)  Is  bandllmlted,  as 
most  physical  signals  are  [20],  the  filter  T(s)  • 
should  be  chosen  to  have  stopband  characteristics 
over  the  range  of  frequencies  present  in  f(t).* 

*In  linear  systems  of  the  Integrating  type  (de- 
scribed by  state  equations  without  direct  lnput-to- 
output  coupling)  the  Inputs,  even  If  they  are  not 
bandllmlted,  may  be  considered  to  be  bandllmlted 
for  all  practical  purposes  as  far  as  thalr  effects 
upon  the  system  state  are  concerned. 


Were  the  filter  transmittance  zero  over  this 
band,  f(t)  would  satisfy  (2)  exactly,  with  e(t)"0. 

The  thrust  of  classical  filter  theory  over 
the  years  has  been  primarily  toward  practical, 
realizable  designs  such  as  all-pole  filters  and 
others  In  which  the  number  of  poles  exceeds  the 
number  of  zeros  in  the  filter  transfer  function 
[21-22],  Well  known  techniques,  however  may  be 
brought  to  bear  upon  the  less  conventional  problem 
faced  here. 

4.  Solutions  for  Optimal  Filters 

Performance  Criterion  and  Constraints 

Let  the  signal  f(t)  be  band limited  at  radian 
frequency  s>o.  Then  a particularly  useful  aqd 

common  measure  of  the  performance  of  T(s)  as  a 
bandstop  filter  over  the  frequency  range  between 
Hi  - 0 and  u “ U Is 

° lil  - 

J - / °|T(Ju)|  du. 
o 

Constraints  are  necessary,  though,  to  yield  use- 
ful solutions,  and  the  particular  restrictions 

a - 0 and  a » 1 will  be  used.  The  transfer 
o n 

function  will  thus  be  restricted  to  be  of  the  form 
T(a)  “ s”  + «n_i  en  * + ...  + a^s. 


Requiring  T(s)  to  have  a zero  at  s ■ 0 re- 
flects the  desirability  of  zero  transmittance  of 
the  filter  for  any  constant  component  of  f(t). 

This  Is  to  say  that  the  approximating  function  to 
f(t),  satisfying  (1),  Includes  a possible  constant 
component.  This  requirement  Is  particularly 
Important  in  applications  where  signal  offsets  are 
likely  and  steady-state  performance  Is  of  concern. 

Fixing  the  coefficient  of  the  highest  power 
of  s In  T(s)  Is  a simple  means  of  avoiding  the 
trivial  solution 


n-1 


a 

o 


- 0 


and  is  Justified  by  the  following  observation: 
Since  any  equation  (1)  may  be  chosen  In  such  a 
way  as  to  Include  all  solutions  of  a lower  order 
equation,  the  equation  of  higher  order  gives  at 
least  as  good  an  approximation  to  f(t)  as  does  the 
equation  of  lower  order. 

Low  Order  Results  \ 

The  optimum  first  order  filter  is  constrained 
to  have  transfer  function 


TjCs)  - a, 

which  corresponds  to  the  approximating  differen- 
tial equation 

(df’/dt)  - 0, 

and  an  arbitrary  constant  approximating  function. 


The  optimum  aecond  order  filter  la  found  to 
have  transfer  function 

Tj(s)  - a2. 


corresponding  to 

(dV/dt2)  - 0, 
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and  an  approximating  function  consisting  of  a 
constant  plus  n ramp. 

The  optimum  third  order  and  fourth  order 
filters  are 

Tn(a)  - s3  + (3u> 2/5)s, 

J o 

which  has  imaginary  axis  roots  within  the  stopband 
range,  and 

T^(s)  - s*  + (5u>o2/7)s2 

which  Is  similar  but  with  a repeated  zero  at  a « 0. 
The  repeated  Imaginary  axis  roots  of  Tj(s) 

and  T,(s)  Indicate  Instability  of  the  approximat- 
ing differential  equation,  but  such  Instability  of 
the  observed  "plant"  is  of  no  particular  concern 
in  observer  design  since  observer  eigenvalues  may 
be  placed  arbitrarily  [2-3,  18-19]. 

Properties  of  the  Optimal  Transfer  Functions 

It  Is  particularly  convenient  at  this  point 
to  consider  T(s)  in  the  factored  form 

T(s)  - s(s4a)(s2+6jS  4^)  (s2482s4y2)  . . . , 

where  the  real  root  term  (s+a)  Is  present  if  T(s) 

Is  of  even  order  and  Is  deleted  If  T(s)  la  of  odd 
order.  Then 

| T< ju)  | 2 - J (w2+a2)  (a)4+812(a2-2Y1<a2nl2) 

4 2 2 2 2 

(u  +82  U)  -2y2u  +Y2  ) . . . 

The  performance  measure  la 

J - /o°|T(J(i))|2du> 

and  one  obtains 

3J/3a  • /o0(i)2(2o)(ia4+612u2-2Y1u2TY12)  ...  du 

Setting  this  derivative  to  zero,  one  has  a « 0 in 
view  of  the  nonegativity  of  the  remaining  factors 
In  the  Integrand.  Further, 

3J/38.  - /“o2(u2  4 a2) (28,w2) 

AO  .1 

(u*  + B22ui2  - 2y2<u2  + Y22)  • • •<!“» 
from  vhlch  It  la  evident  that  8^  ” 0,  and,  similar- 
ly, that  82  " 83  ...  - 0. 

Taking  the  remaining  partial  derivatives  such 
as  3J/3y^  gives  the  further  conditions  for  mini- 
mization of  J,  but  in  a difficult  form.  Having 
derived  the  Important  result  that,  depending  upon 
the  transfer  function  order,  the  optimal  T(s)  la 
either  an  even  or  an  odd  polynomial,  we  now  return 
to  the  serial  polynomial  notation. 

Ceneral  Solution 

For  an  even  or  odd  polynomial. 


alTOaOl'/SSj  - 2ia1[u"-an_2w,w+an_4 


n-2. 


T(s)  - s"  4 \-2*n~2  4 W"~4  + *"» 


ftcvd 


|T(Jw)|Z  -[wn 


n-2 


Interchanging  the  order  of  Integration  and  dlfftr- 
entlation  in  taking  SJ/da^,  one  has 


n-4 


...] 


so  that 


3J/3a.  " 2/  ° [w1*41  - a 
1 o 


.u"41-2  4 


h-2 

\»-4w"+1'4  - 

Equating  to  zero,  there  results  the  system 
of  linear  algebraic  equations 


n+1-1 


n+i-3 


n + 1 - 1 n-2  n 4 1 - 3 n-4 


1 , -2 
n 4 1 - 1 <“o 


n 4 1 4 1 
1 


n-2' 


n 4 1-3  ^‘nV  4 


**’  n 4 1 4 1* 

1 » (n  - 2),  ( n - 4),  ... 
_2 

which  may  be  solved  to  obtain  (u  a .) , 

_z  ° n'z 

K *n-43,  •” 

The  next  few  optimal  transfer  functions  that 
result  ate  as  follows; 

T.(s)  - *5  4 (l.ll)ta  2s3  4 (0.238)u  * 

) o o 

T,(a)  - a6  4 (1.27 )iii  2s*  4 (0. 353)ie  *s2 

b O O 

T,(s>  - a7  4 (1.62)u  2a5  4 (i).734)u)  *s3  4 
/ 0 0 

(0.0816)a  ®s  — 
o 

T.(a)  - a8  4 (1.80)u  V 4 (0.969)u  *a*  4 
o o o 

(0.147)u  6a2 
o 

In  the  next  section.  It  is  shown  how  the 
above  results  can  be  used  In  two  signal  process- 
ing applications. 

5.  Examples 

Observing  a System  State 
Consider  the  system 


y-  [i  l] 


[::] 


if(t) 


where  f(t)  Is  an  unknown  Input  signal.  The  trans- 
fer functions  relating  f(t)  to  the  state  signals 
Xj(t)  and  Xj(t)  are 

TjCa)  - (•  4 l>/(.2  4 Ji  4 3) 

Tj(«)  - (•  -!)/(•*  + J*  ♦ J) 

respectively. 
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Each  of  these  transfer  functions  exhibits 
frequency  reopunne  which  approaches  -20  decibels 
per  decade  above  about  2 radians  per  second.  If 
the  amplitude  of  the  spectrum  of  f(t)  Is  bounded 
at  high  frequencies,  the  effects  upon  the  state 
of  the  high  frequencies,  In  comparison  with  the 
lower  frequencies  In  f(t),  will  be  small. 

For  example.  If  f(t)  Is  a square  wave  of 
radian  frequency  1,  the  third  harmonic  amplitude 
In  Xj  and  x^  will  be  approximately  0.15  as  large 

as  the  fundamental.  The  relative  amplitude  of 
the  fifth  harmonic  will  be  less  than  0.05. 


Taking  u • 10  to  be  the  effective  band  11m- 
o 

it  of  the  input  signal,  f(t)  Is  approximated  by 
f'(t),  where  f*  is  chosen  to  satisfy  the  optimal 
third  order  approximation 

(d3f/dt3)  + (3u  2/5)(df’/dt)  - 0, 
o 

the  augmented  system  equations  become 


An  observer  of  this  system  will  provide  estimates 
of  the  system  state  and,  if  desired,  of  f(t). 
Examples  of  analog  computer  simulations  of  such 
problems  appear  In  [19J. 

Observing  a Filtered  Signal 

In  many  practical  applications,  for  example 
In  biomedical  Instrumentation  and  economic  model- 
ing, it  Is  desired  to  estimate  Inaccessible 
signals  which  may  be  considered  to  be  unknown 
Inputs  to  filters  wherein  only  the  output  signals 
are  available. 


One  approach  Is  to  consider  the  unknown  and 
Inaccessible  signals  to  be  generated,  approxi- 
mately, by  free  systems  of  the  type  (1).  The 
avalleble  output  signals  ere  then  considered  to 
be  produced  by  the  larger  system  consisting  of 
the  actual  system  augmented  by  the  approximating 
equations.  An  observer  of  the  augmented  system 
will  then  generate  estimates  of  the  Inaccessible 
signals  [18], 

Consider  an  Inaccessible  signal  f(t)  which 
Is  processed  by  a simple  low-pass  filter  to  pro- 
duce the  available  signal  y(t)  where 

T(s)  - [l/(s  + 1)]f(s)  - C(e)F(s). 

This  filter  Is  represented  by  the  system 
i ■ -*  ♦ f(t) 

y - *• 


An  Identity  observer  of  the  augmented  system, 
with  eigenvalues  chosen  to  be  -3  and  -4  Is 


• 

- 

* 

li 

m 

-7 

1 

*1 

+ 

6 

\ 

-12 

0 

,r2. 

12 

and  the  signal  z.(t)  observes  f’(t),  and  thus 
provides  an  estimate  of  f(t). 

The  observer  transfer  function  Is 

bm  - 

s + 7s  + 12 

which  Is  Identical  to  that  obtained  by  the  con- 
ventional means  in  which  H(s)  Is  chosen  to  be  the 
Inverse  of  G(s),  with  additional  poles  added  so 
that  It  has  more  poles  than  zeros  [23].  It  is 
particularly  Interesting  that  the  methods  de- 
scribed here  show  how  conventional  Inverse  filter 
techniques  may  be  logically  and  easily  extended  to 
approximations  of  arbitrarily  high  order  In 
multivariable  systems. 

In  this  connection.  It  is  worth  emphasizing 
that  the  optimal  approximating  functions  are  a 
constant  for  the  first  order  and  a constant  plus 
ramp  for  the  second  order,  function*  which  sre 
quite  familiar  in  classical  circuit  and  control 
theory.  The  results  'or  the  third  and  higher 
orders,  however,  depend  upon  u , the  band  limit 
of  the  signal  f(t). 


6.  Conclusion 

It  has  been  shown  how  Inaccessible  signals 
which  are  taken  to  be  bandllmlted,  but  otherwise 
arbitrary,  can  be  suitably  modeled  for  Inclusion 
In  a variety  of  signal  processing  applications. 
The  model  amounts  to  approximate  representation 
of  the  signal  as  a solution  of  a differential 
equation  with  the  coefficients  of  the  latter  de- 
termined to  minimize  the  Integral-square  passband 
error  of  the  approximation.  Properties  of  these 
approximations  were  Investigated  and  the  coeffi- 
cients of  the  representations  up  to  order  8 were 
determined.  Applications  of  the  results  were 
Illustrated  In  two  examples,  the  first  yielding 
reconstruction  of  the  state  of  a second-order 
dynamic  system  which  Is  subject  to  a bandllmlted 
disturbance  signal,  the  second  the  recovery  of 
such  a signal  from  output  measurements  alone. 

In  tha  latter  case,  an  Intimate  connection  with 
Inverses  was  established. 

Additional  research  has  Indicated  that  the 
approach  given  here  can  be  extended  to  certain 
problems  In  digital  signal  processing  [24]. 


Approximating  f(t)  by  f'(t),  where  f'  satis- 
fies .the  optimal  first  order  differential  equation 

i*  - 0, 

glass  the  augmented  system 
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